Comparison of Bayesian Objective Procedures for Variable Selection in Linear Regression
نویسندگان
چکیده
In the objective Bayesian approach to variable selection in regression a crucial point is the encompassing of the underlying nonnested linear models. Once the models have been encompassed one can define objective priors for the multiple testing problem involved in the variable selection problem. There are two natural ways of encompassing: one way is to encompass all models into the model containing all possible regressors, and the other one is to encompass the model containing the intercept only into any other. In this paper we compare the variable selection procedures that result from each of the two mentioned ways of encompassing by analysing their theoretical properties and their behavior in simulated and real data. Relations with frequentist criteria for model selection such as those based on the R2 adj , and Mallows Cp are provided incidentally.
منابع مشابه
Bayesian Predictive Simultaneous Variable and Transformation Selection in the Linear Model
Variable selection and transformation selection are two commonly encountered problems in the linear model. It is often of interest to combine these two procedures in an analysis. Due to recent developments in computing technology, such a procedure is now feasible. In this paper, we propose two variable and transformation selection procedures on the predictor variables in the linear model. The r...
متن کاملInflation Behavior in Top Sukuk Issuing Countries: Using a Bayesian Log-linear Model
This paper focused on developing a model to study the effect of sukuk issuance on the inflation rate in top sukuk issuing Islamic economies at 2014. For this purpose, as the available sample size is small, a Bayesian approach to regression model is used which contains key supply and demand side factors in addition to the outstanding sukuk volume as potential determinants of inflation rate...
متن کاملPenalized Bregman Divergence Estimation via Coordinate Descent
Variable selection via penalized estimation is appealing for dimension reduction. For penalized linear regression, Efron, et al. (2004) introduced the LARS algorithm. Recently, the coordinate descent (CD) algorithm was developed by Friedman, et al. (2007) for penalized linear regression and penalized logistic regression and was shown to gain computational superiority. This paper explores...
متن کاملBayesian Inference for Spatial Beta Generalized Linear Mixed Models
In some applications, the response variable assumes values in the unit interval. The standard linear regression model is not appropriate for modelling this type of data because the normality assumption is not met. Alternatively, the beta regression model has been introduced to analyze such observations. A beta distribution represents a flexible density family on (0, 1) interval that covers symm...
متن کاملThe Comparison of Multi-variable Linear Regression and Artificial Neutral Networks in Tax Evasion of Legal Persons in Iranian Tax System
Tax evasion is one of the most important problems of tax system in the most countries around the world. It covers any unlawful attempt to avoid paying taxes. In present study, the affective factors on tax evasion based on experts’ views were extracted by using Delphi method, so we identified 29 factors and finally 16 factors were extracted based on measurement ability among them. The statistica...
متن کامل